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Abstract. We begin by considering second order dynamical systems of the from x{t)+j{t)x{t) + 
X{t)B{x{t)) = 0, where R : R —)• R is a cocoercive operator defined on a real Hilbert space Ti, 
A : [0, +oo) ^ [0, +oo) is a relaxation function and 7 : [0, + 00 ) [0, + 00 ) a damping function, 

both depending on time. For the generated trajectories, we show existence and uniqueness of 
the generated trajectories as well as their weak asymptotic convergence to a zero of the operator 
B. The framework allows to address from similar perspectives second order dynamical systems 
associated with the problem of finding zeros of the sum of a maximally monotone operator and 
a cocoercive one. This captures as particular case the minimization of the sum of a nonsmooth 
convex function with a smooth convex one. Furthermore, we prove that when B is the gradient 
of a smooth convex function the value of the latter converges along the ergodic trajectory to its 
minimal value with a rate of 
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1 Introduction and preliminaries 

This paper is motivated by the heavy ball with friction dynamical system 

X-|-7X-I- V/(x) = 0, (1) 

which is a nonlinear oscillator with damping 7 > 0 and potential / : R —)• M, supposed to be 
a convex and differentiable function defined on the real Hilbert space R. The system dH) is a 
simplified version of the differential system describing the motion of a heavy ball that keeps 
rolling over the graph of the function / under its own inertia until friction stops it at a critical 
point of / (see M)- Motivated by different models of friction, in a generalized version of 

© has been investigated in finite-dimensional spaces, by replacing the damping jx with d‘h(i;), 
which is the convex sub differential of a convex function $ : —>■ R at x. 

The second order dynamical system has been considered by several authors in the context 
of minimizing the function /, these investigations being either concerned with the asymptotic 
convergence of the generated trajectories to a critical point of / or with the convergence of the 
function value along the trajectories to its global minimum value (see [HEUSUIl]). It is also worth 
to mention that the time discretization of the heavy ball with friction dynamical system leads 
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to so-called inertial type algorithms, which are numerical schemes sharing the feature that the 
current iterate of the generated sequence is defined by making use of the previous two iterates 
(see, for instance, [3H6l l22ll28ll3T ] ). 

In order to approach the minimization of / over a nonempty, convex and closed set C 
the gradient-projection second order dynamical system 

X + jx + X — Pc{x — rjV f{x)) = 0 (2) 

has been considered, where Pc : Ti ^ C denotes the projection onto the set C and r/ > 0. 
Convergence statements for the trajectories to a global minimizer of / over C have been provided 
in M- Furthermore, in [9], these investigations have been expanded to more general second 
order dynamical systems of the form 


X + ^x + X — Tx = 0, 


( 3 ) 


where T : T-L ^ P is a nonexpansive operator. It has been shown that when 7 ^ > 2 the 
trajectory of ([5D converges weakly to an element in the fixed points set of T, provided the latter 
is nonempty. 


In this manuscript, we first treat the second order dynamical system 

^(0 + + K't)B{x{t)) = 0 , 


( 4 ) 


where B : P ^ P is a cocoercive operator, A : [0, -|-oo) —[0, -t- 00 ) is a relaxation function 
in time and 7 : [0, -|-oo) ^ [0, -|-oo) is a continuous damping parameter. We refer the reader 
to |10II15II24II25II35| for other works where second order differential equations with time dependent 
damping have been considered and investigated in connection with optimization problems. On 
the other hand, second order dynamical systems governed by cocoercive operators have been 
recently considered also in [12] . however, with constant relaxation and damping functions. The 
existence and uniqueness of strong global solutions for (jl|) is obtained by applying the classical 
Cauchy-Lipschitz-Picard Theorem (see m)- We also show that under mild assumptions on the 
relaxation function the trajectory x{t) converges weakly as t —>■ -|-oo to a zero of the operator 
B, provided the latter has a nonempty set of zeros. To this end we use the continuous version 
of the Opial Lemma (see also mini, where similar techniques have been used). 

Further, we approach the problem of finding a zero of the sum of a maximally monotone 
operator and a cocoercive one via a second order dynamical system formulated by making use of 
the resolvent of the set-valued operator, see (1241) . Dynamical systems of implicit type have been 
already considered in the literature in [Tl[2l[T3l[T6l[T8l[20l[2T] . We specialize these investigations 
to the minimization of the sum of a nonsmooth convex function with a smooth convex function, 
which is approached by means of a second order dynamical system of forward-backward type. 
This fact allows us to recover and improve results given in [SJE] in the context of studying ([2]). 
We also emphasize the fact that the explicit discretization of the second order forward-backward 
dynamical system gives rise to a relaxed forward-backward algorithm with inertial effects. By 
approaching minimization problems from continuous perspective we expect to gain more insights 
into how to properly chose the relaxation and damping parameters in the corresponding iterative 
schemes in order to improve their convergence behavior. Finally, whenever B is the gradient 
of a smooth convex function we show that the value of the latter converges along the ergodic 
trajectories generated by (HD to its minimum value with a rate of convergence of 

Throughout this paper N = {0,1,2,...} denotes the set of nonnegative integers and P a real 
Hilbert space with inner product (•, •) and corresponding norm 11-11 = •). 
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2 Existence and uniqueness of strong global solutions 

This section is devoted to the study of existence and uniqueness of strong global solutions of a 
second order dynamical system governed by Lipschitz continuous operators. 

Let i? : —)• be an L-Lipschitz continuous operator (that is L > 0 and \\Bx — By\\ < 

L||x— 7/11 for all X, y G "H), A, 7 : [0,+oo) — [0,+oo) be Lebesgue measurable functions, uo,vo gB 
and consider the dynamical system 

f x(t)+ 7 (t)x(t) + A(t).B(x(t)) = 0 , . 

\ x( 0 ) = uo,x{0) =vo. ^ 

As in mm, we consider the following definition of an absolutely continuous function. 


Definition 1 (see, for instance, mm) A function x : [0, 6 ] — )• (where 6 > 0) is said to be 

absolutely continuous if one of the following equivalent properties holds: 

(i) there exists an integrable function y : [0,b] ^ B such that 

x(t) = x(0) + f y{s)ds VtG[0, 6 ]; 

Jo 

(ii) X is continuous and its distributional derivative x is Lebesgue integrable on [0,b]; 

(hi) for every e > 0, there exists rj > 0 such that for any hnite family of intervals B = (ofc, b^) 
we have the implication 

1 4 n /j- = 0 and ^ |6fc - afcl < 7/1 ^ ^ Ik(fefc) - x{ak)\\ < e. 

V k / k 

Remark 1 (a) It follows from the definition that an absolutely continuous function is dif¬ 
ferentiable almost everywhere, its derivative coincides with its distributional derivative almost 
everywhere and one can recover the function from its derivative x = yhy the integration formula 

(i)- 

(b) If X : [0, 6 ] —)• (where 6 > 0) is absolutely continuous, then the function z = B o x 
is absolutely continuous, too. This can be easily seen by using the characterization of absolute 
continuity in Definition [T](iii). Moreover, 2 is almost everywhere differentiable and the inequality 
||'^(•)ll ^ -^ll®(')ll bolds almost everywhere. 


Definition 2 We say that x : [0, -|-oo) — )• is a strong global solution of ([5]) if the following 

properties are satished: 

(i) X, X : [0, -boo) —>• B are locally absolutely continuous, in other words, absolutely continu¬ 
ous on each interval [ 0 , 6 ] for 0 < 6 < -boo; 

(ii) x{t) + y{t)x{t) + X{t)B{x{t)) = 0 for almost every t G [0, -boo); 

(hi) x( 0 ) = uq and x( 0 ) = 7 ;o. 


For proving the existence and uniqueness of strong global solutions of dS} we use the Cauchy- 
Lipschitz-Picard Theorem for absolutely continues trajectories. The key observation here is that 
one can rewrite ([5]) as a particular first order dynamical system in a suitably chosen product 
space (see also m)- 

Theorem 2 Let B : B ^ B be an L-Lipschitz continuous operator and A, 7 : [0,-boo) —>■ 
[0, -boo) be Lebesgue measurable functions such that A, 7 G 4 oc([*^’ +00)) (that is G L^([0, b]) 
for every 0 < 6 < -booj. Then for each G B there exists a unique strong global solution of 

the dynamical system m- 
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( 6 ) 


Proof. The system ([2]) can be equivalently written as a first order dynamical system in the 
phase space H x H 

Y{t)=F{t,Yit)) 

y(0) = ('uo,t’o), 

with 

Y : [0, +oo) Ti xTi, Y(t) = {x{t),x{t)) 

and 

F : [0, +oo) X H X T-L ^ H X T-L, F{t, u, v) = (v, —j(t)v — A(t)Bu). 

We endow T-LxT-L with scalar product {{u,v), {u^v))y,x'hL = + {v-,v) and corresponding 

norm \\{u,v)\\'h.xH = VikP + IbP- 

(a) For arbitrary u,u,v,v £ Ti, by using the Lipschitz continuity of the involved operators, 
we obtain 


\\F{t,u,v) - F{t,u,v)\\nxn = \/\\v - v\\^ + || 7 (t)(u - u) + X{t){Bu - Bu)\\^ 

< -^(1 + 2j‘^{t))\\v — up + 2L‘^X‘^{t)\\u — rip 

< y/l + 272 (t) + 2L‘^X‘^{t)\\{u,u) - {v,v)\\'Hxn 

< (1 + v^ 7 (t) + V2LX{t))\\{u,u) - iv,v)\\-uxH Vt > 0. 

As A ,7 G + 00 )), the Lipschitz constant of F(t,-,-) is locally integrable. 

(b) Next we show that 

Vn,u G n, V 6 > 0, F{-,u,v) G L\[0,b],'H x U). 

For arbitrary u,v and 6 > 0 it holds 

[ \\F{t,u,v)\\nxndt= [ VibP + \\'lii)v + X{t)Bufdt 
Jo Jo 

. [ V{l + 2j^t))\\v\\^ + 2X^{t)\\Bu\\^dt 
Jo 

j ((1 + '^'y{t))\\v\\ + V2X{t)\\Bu\\^ dt 


( 7 ) 


< 


< 


and from here, by using the assumptions made on A, 7 , ([7|) follows. 

In the light of the statements (a) and (b), the existence and uniqueness of a strong global 
solution for ([ 6 ]) follow from the Cauchy-Lipschitz-Picard Theorem for first order dynamical 
systems (see, for example, m Proposition 6.2.1]). The conclusion is a consequence of the 
equivalence of ([5]) and ([ 6 ]). ■ 


3 Convergence of the trajectories 

In this section we address the convergence properties of the trajectories generated by the dynam¬ 
ical system ([5]) by assuming that B -.T-L ^ B is /J-cocoercive for fJ > 0, that is f3\\Bx — By\\‘^ < 
{x — y,Bx — By) for all x,y ^ B. This implies that B is ^-Lipschitz continuous, li B = Vg, 
where —>■ M is a convex and differentiable function such that V 5 is ^-Lipschitz continuous, 

then the reverse implication holds, too. Indeed, according to the Baillon-Haddad Theorem, Vg 
is a /3-cocoercive operator (see [T71 Corollary 18.16]). 

The following results, which can be interpreted as continuous versions of the quasi-Fejer 
monotonicity for sequences, plays an important role in the forthcoming investigations. For their 
proofs we refer the reader to [21 Lemma 5.1] and [21 Lemma 5.2], respectively. 
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Lemma 3 Suppose that F : [0, +oo) —>■ M zs locally absolutely continuous and bounded below 
and that there exists G E L^([0,+oo)) such that for almost every t E [0,+oo) 

^F(t) < G(t). 

Then there exists F{t) E M. 

Lemma 4 If 1 < p < oo, 1 < r < oo, F : [0, +oo) —)• [0, +oo) is locally absolutely continuous, 
F E LP([0, +oo)), G : [0, +oo) ^ M, G E L'’([0, +oo)) and for almost every t E [0, +oo) 

|F(t) < G(t), 

then limj^+oo F{t) = 0. 

The next result which we recall here is the continuous version of the Opial Lemma (see, for 
example, [21 Lemma 5.3], [H Lemma l.lOj). 

Lemma 5 Let S FH be a nonempty set and x : [0, +oo) H a given map. Assume that 
(i) for every x* E S, lim 4 _>.+oo ||a:(t) — x*|| exists; 

(a) every weak sequential cluster point of the map x belongs to S. 

Then there exists Xoo E S such that x{t) converges weakly to Xoo as t ^ +oo. 

In order to prove the convergence of the trajectories of ([5]), we make the following assumptions 
on the relaxation function A and the damping parameter 7 , respectively: 

(Al) A, 7 : [0,+00) —)• ( 0 ,+00) are locally absolutely continuous and there exists 9 > 0 such 
that for almost every t E [ 0 , +00) we have 

if j 1 ^ 

iit) < 0 < X{t) and . ( 8 ) 

Due to Definition [T] and Remark [T](a), X{t),'y{t) exists for almost every t > 0 and A, 7 are 
Lebesgue integrable on each interval [0, b] for 0 < 6 < + 00 . This combined with 'jft) < 0 < X{t) 
and the fact that A, 7 take only positive values yield the existence of a positive lower bound A 
for A and of a positive upper bound 7 for 7 . Furthermore, the second assumption in ([ 8 |) provides 
also a positive upper bound A for A and a positive lower bound 7 for 7 . Notice that the couple 
of functions 

X{t) = -7-- and 7 (t) = a'e~^ * + b', 

ae-P^ + b ^ 

where a, a', p, p' > 0 and 6 , 6 ' > 0 fulfill the inequality b'^b > verify the conditions in assump¬ 
tion (Al). 

We would also like to point out that under the conditions considered in (Al) the global 
version of the Picard-Lindelof Theorem allows us to conclude that, for uo,vq E H, there exists 
a unique trajectory x : [0, -|-oo) —f TL which is a G^ function and which satisfies the relation (ii) 
in Definition 2 for every t E [0,-|-oo). The considerations we make in the following take into 
account this fact. 

We state now the convergence result. 

Theorem 6 Let B : % ^ TL be a /I-cocoercive operator for /3 > 0 such that Zei B := {u E 
Tl : Bu = 0} / 0, A ,7 : [0,-|-oo) —f (0,-|-oo) be functions fulfilling (Al) and uo,vo E TL. Let 
X : [0,-|-oo) TL be the unique strong global solution of ([S]). Then the following statements are 
true: 

(i) the trajectory x is bounded and x,x,Bx E L^([ 0 ,-|-oo); ^); 

(ii) limt^+oo x(t) = limi ^+00 x(t) = linit^+oo B{x{t) = 0; 

(Hi) x{t) converges weakly to an element in Zer B as t ^ -|-oo. 


5 





Proof, (i) Take an arbitrary x* G Zer B and consider for every t G [0,+oo) the function 
h{t) = ^||x(t) — x*|p. We have h{t) = {x{t) — x*,x{t)) and 'h{t) = ||i;(t)|p + {x{t) — x*,x{t)) for 
every t G [0, +oo). Taking into account ([5]), we get for every t G [0, +oo) 

’h{t) + 'y{t)h{t) + X{t) {x{t) - x*,B{x{t))) = ||x(t)|p. (9) 


The cocoercivity of B and the fact that Bx* = 0 yields for every t G [0, +oo) 


h{t) + + f3X{t)\\B{x{t))f < \\x{t)f. 


Taking again into account ([5]) one obtains for every t G [0, +oo) 

h{t) + 7(t)/i(t) + < ||x(t)f 

or, equivalently, 

Mt)+7(t)Mt)+^ - "■ 

Combining this inequality with 


7(0 d 
X{t) dt 


’■) = 




and 

7 ( 0^(0 = > ^(^^)( 0 > 

it yields for every t G [0, Too) 


( 10 ) 


( 11 ) 


Ht) + ^('i^)(0+ 

4 - 




/3 

m 


x{t)\\"<0. 


Now, assumption (Al) delivers for almost every t G [0, +oo) the inequality 

This implies that the function t i-G h{t) + 'y{t)h{t) + /3j|^||x(t)|p, which is locally absolutely 
continuous, is monotonically decreasing. Hence there exists a real number M such that for every 
t G [0, “hex;)) 

h{t) + -f{t)h{t) + p^\\x{t)f < M, (13) 

which yields that for every t G [0, +oo) 

h{t) + 7 / 1 ( 1 ) < M. 

By multiplying this inequality with exp( 7 l) and then integrating from 0 to T, where T > 0, one 
easily obtains 

M 

h{T) < /i(0) exp(- 7 T) H-(1 -exp(- 7 r)), 

- 7 


6 















thus 


h is bounded 


(14) 


and, consequently, 

the trajectory x is bounded. (15) 

On the other hand, from (fT^ . it follows that for every t G [0, +oo) 

h{t) + l5j_X ^\\x{t)\\^<M, 

hence 

{x{t) — X* ,x{t)) + ^\\x{t)\\‘^ < M. 

This inequality in combination with ()15ll yields 

X is bounded, (16) 

which further implies that 

h is bounded. (17) 

Integrating the inequality (|12p we obtain that there exists a real number G M such that 
for every t G [0, +oo) 

h{t) + ^{t)h{t) + p'^^^^\\x{t)\\'^ + 6 f ||x(s)|p(is +/3A ^ f ||x(s)||^ds < iV. 

X[t) Jo Jo 

From here, via (ED, we conclude that x{-),x{-) G L^([0,+oo);"H). Finally, from ([S]) and (Al) 
we deduce Bx G T^([0, +oo);^) and the proof of (i) is complete. 

(ii) For every t G [0, +oo) it holds 

^ Qll^(i)f) = {x{t),x{t)) < ^\\x{t)f + ^||x(t)f 

and Lemma m together with (i) lead to limt_).+(X) x(t) = 0. 

Further, by taking into consideration Remark [T](b), for every t G [0,+oo) we have 

4 (l||B(i(<))ll") = < \\\B{x{t))f + T||i(()||2. 

By using again LemmalHand (i) we get limt_>.+oo B{x{t)) = 0, while the fact that limi_)._|_oo x{t) = 
0 follows from ([5]) and (A2). 

(iii) We are going to prove that both assumptions in Opial Lemma are fulfilled. The first 
one concerns the existence of limj_>.+oo l|3^(^) ~ s;* ||. As seen in the proof of part (i), the function 
t !->■ h{t) + 'y{t)h{t) + /dy|^||i(t)|p is monotonically decreasing, thus from (i), (ii) and (Al) we 
deduce that lim^^+oo 7 (t)/i(t) exists and it is a real number. By taking also into account that 
3limi_j._|_oo 7 (t) G (0,oo), we obtain the existence of limt^+oo ||a;(t) — 

We come now to the second assumption of the Opial Lemma. Let T be a weak sequential 
cluster point of x, that is, there exists a sequence tn —>■ +oo (as n —>■ +oo) such that {x{tn))neN 
converges weakly to x. Since R is a maximally monotone operator (see for instance m Example 
20.28]), its graph is sequentially closed with respect to the weak-strong topology of the product 
space TJ X TJ. By using also that lim„_>.+c« R(x(t,i)) = 0, we conclude that Bx = 0, hence 
X G Zer B and the proof is complete. ■ 
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A standard choice of a cocoercive operator defined on a real Hilbert spaces is H = Id —T, 
where T : —)• is a nonexpansive operator, that is, a 1-Lipschitz continuous operator. As 

it easily follows from the nonexpansiveness of T, B is in this case 1/2-cocoercive. For this 
particular operator B the dynamical system Q becomes 

f x{t) + 7 (t)x(t) + \{t) (x(t) - T{x{t))) =0 , . 

\ x(0) = uo,i;(0) = uo, ^ 

while assumption (Al) reads 

(A 2 ) A, 7 : [ 0 ,+oo) ^ (0,+oo) are locally absolutely continuous and there exists 9 > 0 such 
that for almost every t € [ 0 , +oo) we have 

i{t) < 0 < X{t) and > 2(1 + 9). (19) 

X{t) 

Theorem [ 6 ] gives rise to the following result. 


Corollary 7 Let T : LL ^ Ti be a nonexpansive operator such that FixT := {u G B : Tu = u} ^ 
0, A, 7 : [0, +oo) —)• (0, +oo) be functions fulfilling (A2) and uq, vq gB. Let x : [0, +oo) B be 
the unique strong global solution of (USD- Then the following statements are true: 

(i) the trajectory x is bounded and x,x, (Id—r)x G L^([0,+oo);7^); 

(ii) limt^+ooi(t) = ^^m^+oo xit) = liuit^+ooi^d -T){x{t)) = 0; 

(Hi) x{t) converges weakly to a point in FixT as t ^ +oo. 

Remark 8 In the particular case when j{t) = 7 > 0 for all t > 0 and X{t) = 1 for all t G [0, + 00 ) 
the dynamical system (I18p becomes 

( x{t)+ -fx{t)+ x{t)-T{x{t)) = 0 

\ x(0) = no,x(0) = uq. 

The convergence of the trajectories generated by (|20p has been studied in [9l Theorem 3.2] under 
the condition 7 ^ > 2. In this case (A2) is obviously fulfilled for an arbitrary 0 < 0 < ( 7 ^ — 2)/2. 
However, different to [9], we allow in Corollary [7] nonconstant damping and relaxation functions 
depending on time. We would also like to notice that in [3] an anisotropic damping has been 
considered in the context of approaching the minimization of a smooth convex function via 
second order dynamical systems. 


We close the section by addressing an immediate consequence of the above corollary applied 
to second order dynamical systems governed by averaged operators. The operator R -.B ^B\s 
said to be a-averaged for a G (0,1), if there exists a nonexpansive operator T :B ^ B such that 
R = (1 — a) Id +aT. For a = ^ we obtain as an important representative of this class the firmly 
nonexpansive operators. For properties and insights concerning these families of operators we 
refer to the monograph m- 

We consider the dynamical system 

/ x{t)+-f{t)x{t) + X{t){x{t)-R{x{t))) =Q 

\ x(0) = uo,x(0) =vq ^ ’ 

and formulate the assumption 


(A3) A, 7 : [0,+oo) —)• (0,+oo) are locally absolutely continuous and there exists 0 > 0 such 
that for almost every t G [0, + 00 ) we have 


7 (t) < 0 < A(t) and 


m 


> 2a{l + 9). 


( 22 ) 
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Corollary 9 Let R : LL ^ LL be an a-averaged operator for a G (0,1) such that FixR / 0, 
A, 7 : [0,+oo) —(0,+oo) be functions fulfilling (A3) and uo,vo G R. Let x : [0,+oo) R be 
the unique strong global solution of m- Then the following statements are true: 

(i) the trajectory x is bounded and x,x, (Id—ii)x G L^([0, +oo); ^); 

(a) limt^+oo xit) = linii^+oo xit) = limi^+oo(Id -R){x{t)) = 0; 

(Hi) x{t) converges weakly to a point in Fixi? as t ^ +oo. 

Proof. Since R is a-averaged, there exists a nonexpansive operator T : R ^ R such that 
R = {1 — a)Id-|-aT. The conclusion is a direct consequence of Corollary [71 by taking into 
account that (l2T|) is equivalent to 

( x{t) + 7 (t)x(t) -|- aA(t)(x(t) — T(x(t))) = 0 
\ x(0) = uo,^(0) = uo, 

and Fix i? = Fix T. ■ 


4 Forward-backward second order dynamical systems 


In this section we approach the monotone inclusion problem 


find 0 G A{x) + B{x), 


where A : R ^R is a maximally monotone operator and B : R ^ R is a /3-cocoercive operator 
for /3 > 0 via a second order forward-backward dynamical system with relaxation and damping 
functions depending on time. 

For readers convenience we recall at the beginning some standard notions and results in 
monotone operator theory (see also |17[ll9y34j b For an arbitrary set-valued operator A : R ^R 
we denote hy Gi A = {{x,u) G R x R : u G Ax} its graph. We use also the notation Zer A = 
{x gR : 0 G Ax} for the set of zeros of A. We say that A is monotone, ii {x — y,u — v) >0 for all 
{x,u), {y,v) G Gr A. A monotone operator A is said to be maximally monotone, if there exists 
no proper monotone extension of the graph of A onR xR. The resolvent of A, Ja '■ R ^ R, is 
defined by Ja = (Id-|-A)“^. If A is maximally monotone, then Ja ■ R ^ R is single-valued and 
maximally monotone (see m Proposition 23.7 and Corollary 23.10]). For an arbitrary 7 > 0 
we have (see m Proposition 23.2]) 

p G J^AX if and only if (p, 7 “^(x — p)) G Gr A. (23) 


The operator A is said to be uniformly monotone if there exists an increasing function 
4>a '■ [ 0 , -|-oo) ^ [ 0 , -t- 00 ] that vanishes only at 0 and fulfills {x — y,u — v) > 4>a (ll^c — ?/||) for all 
{x,u),{y,v) G GrA. A popular class of operators having this property is the one of strongly 
monotone operators. We say that A is 7 -strongly monotone for 7 > 0, if {x — y,u — v) > 7 ||x —?/|p 
for all {x,u), {y,v) G GrA. 

For 7 > 0 we consider the dynamical system 


xit) + lit)x{t) + X{t) xit) - JrjA (xit) - gBix 

x(0) = uo,i;(0) = vq. 


= 0 


(24) 


Further, we consider the following assumption, where 5 := 2 / 3 '^ ' 

(A4) A, 7 : [0,-|-oo) —)• (0,-|-oo) are locally absolutely continuous and there exists 9 > 0 such 
that for almost every t G [0, -|-oo) we have 


fit) < 0 < Xit) and 


xHt) ^ 2(1+ g) 

Xit) - S ' 


(25) 
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Theorem 10 Let A : LI ^ LI be a maximally monotone operator and B : LL ^ LL be a (3- 
cocoercive operator for (3 > 0 such that Zer(^ + i?) / 0 . Let t] E (0,2/3) and set 6 := Let 

A, 7 : [0,+oo) —)• (0,+oo) be functions fulfilling (A4), uo,vo E Li and x : [0,+oo) LL be the 
unique strong global solution of (1241) . Then the following statements are true: 

(i) the trajectory x is bounded and x,x, [ld—Jr^A° {ld—r]B))x E -L^([0,+oo);^); 

(a) limt^+ooi(i) = dmt^+oox{t) = limf^+oo o (Jd -t]B)) {x{t)) = 0; 

(Hi) x{t) converges weakly to a point in Zer(A + B) as t ^ +oo; 

(iv) if X* E Zer(A + B), then B{x{-)) — Bx* E A^([0, +oo)]LL), limi_,._|_oo B{x{t)) = Bx* and 
B is constant on Zer{A + B); 

(v) if A or B is uniformly monotone, then x{t) converges strongly to the unique point in 
Zer(A + B) as t ^ +oo. 


Proof. (i)-(iii) It is immediate that the dynamical system ()24p can be written in the form 

f x{t)+'y{t)x{t) + X{t)(^x{t) - R{x{t))) = 0 , 

\ x(0) = uo,x(0) = no, ^ 


where R = JrjA ° {Id— rjB). According to [T71 Corollary 23.8 and Remark 4.24(iii)], J^^a is 1/2- 
cocoercive. Moreover, by m Proposition 4.33], Id—r/R is r//(2/3)-averaged. Combining this 
with m Theorem 3(b)], we derive that R is l/d-averaged. The statements (i)-(iii) follow now 
from Corollary [9] by noticing that FixR = Zer(A -|- B) (see [171 Proposition 25.1(iv)]). 

(iv) The fact that B is constant on Zer(A -I- B) follows from the cocoercivity of B and the 
monotonicity of A. A proof of this statement when A is the subdifferential of a proper, convex 
and lower semicontinuous function is given for instance in [H Lemma 1.7]. 

Let be an arbitrary x* E Zer(A -|- B). From the definition of the resolvent we have for every 
t E [0, -(-cx)) 

- ^ ( yj )***’ + + ‘'<‘0 ’ 

which combined with — Rx* E Ax* and the monotonicity of A leads to 


The cocoercivity of B yields for every t E [0, -|-oo) 


l3\\B{x{t)) - Bx*f < -B{x{t)) + Bx*'^- ^^ 1^1 

+ / x{t) — X*, - ■^—^x{t) - '^w\ ^(^) 


x{t) + 7 (t)x 


<- 


1 

1 

¥ 

m 


1 

r]X‘^{t) 

V- 

-2/3 


r]X{t)' 

m + ^i(t) 


\x{t) + 7 (f)x(f)|p -I- ( x{t) - X*, - 


r]X{ty 
+ ^\\B{x{t))-Bx*f 
2 ' !-* ^ x{t) - ^^x{t) 


r]X{ty 


r]X{ty 


2 , t3^*\\2 


2r]l3X‘^{t) A'(^)^WII + 2 ^\B{x{t)) - Bx 

-b / x{t) — X*, - ■^—-x{t) - '-T^x{t) 


r]X{ty 


r]X{ty 


</||B(i(t)) - Bx-f + ^i(t) - - ^i(t) 
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For evaluating the last term of the above inequality we use the function h : [0, +oo) —?■ M, 
h{t) = ^||x(t) — x*|p, already used in the proof of Theorem [6l From 

we obtain for every t G [0, +oo) 

^^\\B{x{t)) - Bx*f+ ^(h{t)+-f{t)h{t)^ < ^\\x{t)f. 

Taking into account also the relation m and the bounds for A, we get for every t G [0, +oo) 
^\\B{x(t)) - Bx'f + i (^h{t) + |(7A)(()) < i||i{*)ll". 

After integration we obtain that for every T G [0, +oo) 

^ J ||B(x(t)) - ^ (^A(r) - A(o) + 7(r)/i(r) - 7(o)/i(o)^ < ^ y \\x{t)\\‘^dt. 

Since x G L^([0,+oo); ^), 7 has a positive upper bound, h{T) > 0,7(r) > 0 for every T G 
[0,+oo) and limr-^.+oo ^(7") = 0, it follows that B{x{-)) — Bx* G L^([0,+oo); ^). 

Further, by taking into consideration Remark [T][^b), we have 


^ (^\\\B{x{t)) - Bx*f'^ = (^B{x{t)) - Bx*, j^{Bx{t))^ < ^\\B{x{t)) - Bx*f + ^||x(t)f 

and from here, in the light of LemmalU it follows that limt_>.+oo B{x{t)) = Bx*. 

(v) Let X* be the unique element of Zer(A + B). For the beginning we suppose that A is 
uniformly monotone with corresponding function ■ [ 0 ,+oo) —>■ [ 0 ,+oo], which is increasing 
and vanishes only at 0 . 

By similar arguments as in the proof of statement (iv), for every t G [0, +oo) we have 


<pA 


.^^x[t)+'Mnt)+x[t)-x’ 


< 




which combined with the monotonicity of B yields 


4 >a 


+ ^i{i) + -(*) - I” 


< 






x{t) — X*, -r77T®(i)-^ 


r]X{ty 


r]X{ty 


.B(x(ty) + Bx^ + y(t) - X-, ~m - ^i(*) >. 


As A and 7 are bounded by positive constants, by using (i)-(iv) it follows that the right-hand 
side of the last inequality converges to 0 as t —>■ -|-oo. Hence 


lim (j)A 
t —^“|~00 


m 


Ht) + + 



= 0 
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and the properties of the function (pA allow to conclude that 

converges strongly to 0 as t ^ +oo. By using again the boundedness of A and 7 and assumption 
(ii) we obtain that x{t) converges strongly to x* as f —>■ + 00 . 

Finally, suppose that B is uniformly monotone with corresponding function <pB ■ [0, +00) — >■ 
[ 0 ,+00], which is increasing and vanishes only at 0 . The conclusion follows by letting t in the 
inequality 

{x{t) — X* , B{x{t)) — Bx*) > (j)B{\\x{t) — x*||) Vt E [ 0 , +00) 
converge to +00 and by using that x is bounded and limt^+oo(-B(x(f) — Bx*) = 0 . ■ 

Remark 11 We would like to emphasize the fact that the statements in Theorem IIUI remain 
valid also for rj := 2/3. Indeed, in this case the cocoercivity of B implies that Id —r]B is nonex- 
pansive, hence the operator R = JnA ° (Id—r/R) used in the proof is nonexpansive, too, and so 
the statements in (i)-(iii) follow from Corollary [71 Furthermore, the proof of the statements (iv) 
and (v) can be repeated also for 7 = 2/3. 


In the remaining of this section we turn our attention to optimization problems of the form 


min/(x) +fi((x), 
x€l-L 


where / : R —)• MU {+ 00 } is a proper, convex and lower semicontinuous function and 5 : R —)• M 
is a convex and (Frechet) differentiable function with ^-Lipschitz continuous gradient for /3 > 0. 

We recall some standard notations and facts in convex analysis. For a proper, convex and 
lower semicontinuous function / : R —)• M U {+ 00 }, its (convex) subdifferential at x E R is 
defined as 

df{x) = {ue'H: f{y) > /(x) + {u,y - x) Vy E R]. 

When seen as a set-valued mapping, it is a maximally monotone operator (see [32]) and its 
resolvent is given by Jndf = prox^j (see [IZ]), where prox^j : R ^ R, 

prox^y(x) = argrnin |/(y) +-^Wv - | , (30) 


denotes the proximal point operator of / and rj > 0. According to [T71 Definition 10.5], / is 
said to be uniformly convex with modulus function (p : [ 0 , +00) ^ [ 0 ,-|-oo], if p is increasing, 
vanishes only at 0 and fulfills /(ax + (1 — a)y) + a(l — a)(p{\\x — y||) < a/(x) + (1 — a)f{y) for 
all a E (0,1) and x,y E dom/ := {x E R : fix) < -|-oo}. Notice that if this inequality holds for 
(p = (i^/ 2 )| • p for > 0 , then / is said to be z^-strongly convex. 

In the following statement we approach the minimizers of /+y via the second order dynamical 
system 


xit) -I- 7(f)x(t) -I- X{t) x{t) — prox^j yx{t) — yVg{x 
x(0) = rto,i;(0) = Vo- 


= 0 


( 31 ) 


Corollary 12 Let f : R —>■ E.U {+00} by a proper, convex and lower semicontinuous function 
and g : R ^ M. be a convex and (Frechet) differentiable function with ^-Lipschitz continuous 

gradient for /3 > 0 such that avgmm^^B.{f{x) + 9{x)} 7 ^ 0- Let g E (0,2/3] and set 6 := ^ 7 ^- 
Let A, 7 : [0, +00) ^ (0, +00) be functions fulfilling (A4), uo,vo E R and x : [0, +00) R be 
the unique strong global solution of (ini). Then the following statements are true: 

(i) the trajectory x is bounded and x,x, (Id — prox^j o(Id — r/Vy))x E L^([0, +00); R); 

(ii) limt^+oo xit) = limi ^+00 xit) = limi ^+00 (Id - prox^j o(Id -gVg)) (x(t)) = 0; 

(Hi) xit) converges weakly to a minimizer of f + g as t ^ +00; 
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(iv) if X* is a minimizer of f + g, then Vg{x{-)) — Vg{x*) G L‘^{[0,+oo)]7i), limt_j.+oo 
Vg{x{t)) = Vg{x*) and Vg is constant on aigicam^^-^{f{x) + g{x)}; 

('^) if f or g is uniformly convex, then x{t) converges strongly to the unique minimizer of 
f + g as t ^ +00. 

Proof. The statements are direct consequences of the corresponding ones from Theorem [10] 
(see also Remark IIip . by choosing A := df and B := \/g, by taking into account that 

Zer((9/ + Vg) = argmin{/(a:) + g{x)}. 
xen 

For statement (v) we also use the fact that if / is uniformly convex with modulus cf, then df is 
uniformly monotone with modulus 24> (see |17l Example 22.3(iii)]). ■ 

Remark 13 Consider again the setting in Remark [S] namely, when 7 ( 1 ) =7 > 0 for every 
t > Ocand X{t) = 1 for every t G [0, +00). Furthermore, for C a nonempty, convex, closed subset 
of 7^, let / = 5c be the indicator function of C, which is defined as being equal to 0 for x £ C 
and to +00, else. The dynamical system m attached in this setting to the minimization of g 
over C becomes 

J x{t) + 'yx{t)+x{t)-Pc{x{t)-r]Vg{xit))) =0 

\ x(0) = uo,i;(0) = no, 

where Pc denotes the projection onto the set C. 

The asymptotic convergence of the trajectories of (|32l) has been studied in m Theorem 3.1] 
under the conditions 7 ^ > 2 and 0 < 7 < 2/3. In this case assumption (A4) trivially holds by 
choosing 9 such that 0 < 0 < ( 7 ^ — 2)/2 < (<^ 7 ^ — 2 )/ 2 . Thus, in order to verify (A4) in case 
X{t) = 1 for every t G [0, + 00 ) one needs to equivalently assume that 7 ^ > 2/5. Since 5 > 1, this 
provides a slight improvement over m Theorem 3.1] in what concerns the choice of 7 . We refer 
the reader also to [ 8 ] for an analysis of the convergence rates of trajectories of the dynamical 
system ([32|) when g is endowed with supplementary properties. 

For the two main convergence statements provided in this section it was essential to choose 
the step size rj in the interval (0,2/3] (see Theorem 1101 Remark 1111 and Corollary I12p . This, 
because of the fact that in this way we were able to guarantee for the generated trajectories the 
existence of the limit lim^^+oo \\x{t) — where x* denotes a solution of the problem under 
investigation. It is interesting to observe that, when dealing with convex optimization problems, 
one can go also beyond this classical restriction concerning the choice of the step size (a similar 
phenomenon has been reported also in [H Section 5.2]). This is pointed out in the following 
result, which is valid under the assumption 

(A5) A, 7 : [ 0 ,+00) —)• ( 0 ,+00) are locally absolutely continuous and there exists 9 > 0 such 
that for almost every t G [ 0 , +00) we have 

7 (t) < 0 < X(t) and > r}9 + ^ + 1. ( 33 ) 

and for the proof of which we use instead of llx(-) — a modihed energy functional. 

Corollary 14 Let f : P. —>■ RU {+00} by a proper, convex and lower semicontinuous function 
and g : P ^ R be a convex and (Frechet) differentiable function with ^-Lipschitz continuous 
gradient for /3 > 0 such that aigmm,^^-^{f {x)+g{x)} 7 ^ 0. Let beg > 0, X ,7 : [0, +00) —>■ (0, +00) 
be functions fulfilling (A5), uo,vo G P and x : [0,+00) P be the unique strong global solution 
of dsn- Then the following statements are true: 
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(i) the trajectory x is bounded and x,x, (Id — prox^j o(Id — t/V( 7 ))x € L^{[0,+ooy,n); 

(a) linit^+oo x{t) = linii^+oo x{t) = linii^+oo (W - prox^j o(Id -r]Vg)) (x(t)) = 0; 
fiiij x{t) converges weakly to a minimizer of f + g as t ^ +oo; 

(iv) if X* is a minimizer of f + g, then Vg{x{-)) — Vg{x*) G L‘^{[0,+oo)]'H), limi_j._|_oo 
Vg{x(t)) = Vg{x*) and Vg is constant on aigmm^^-^{f{x) + 5 (x)}; 

(x) if f or g is uniformly convex, then x{t) converges strongly to the unique minimizer of 
f + g as t ^ + 00 . 

Proof. Consider an arbitrary element x* G argmm,,.^y^{f (x) + g{x)} = Zer{df+'Vg). Similarly 
to the proof of Theorem llOf ivi. we derive for every t G [0,+(X)) (see the first inequality after 

m) 

fd\\Vg{xit))-Vgix*)f< 

^ ( (xit),-Vgix{t)) + Vgix*)) + jit) {x{t),-Vg{x{t)) + Vg{x*)) ) - 

^||*(t) + + (m - r, ~f(t) - ■ P4) 

In what follows we evaluate the right-hand side of the above inequality and introduce to this 
end the function 


q : [0, -hoo) ^ M, q(t) = g(x(t)) - g(x*) - {Vg{x*),x{t) - x*). 


Due to the convexity of g one has 
Further, for every t G [0, -|-oo) 


q{t) > 0 Vt > 0. 


q{t) = {x{t),Vg{x{t)) - Vg{x *)), 


thus 

lit) {x{t),-Vg{x{t)) + Vg{x*)) = --f{t)q{t) = -^ilQ)it) + iit)qit) < -J^ild){t) (35) 
On the other hand, for every t G [0, -|-oo) 

q{t) = {x{t),Vg{x{t)) - Vg{x*)) + ^x{t), ^Vg{x{t))^ , 


hence 

{x{t),-Vg{x{t)) + Vg{x*)) < -q{t) + ^||x(t)f. 
We have for almost every t G [0, -|-oo) (see also (fTOll l 

+ ^(i)i(f) ||2 = ^ ||i{t) 11'^ + ^ ||i(f) f + 


(36) 


(37) 


Finally, by multiplying (IMD with X{t) and by using (I55|) . (ISS]) . (I57|) and (1^^ we obtain after 
rearranging the terms for almost every t G [0, -|-oo) that 


/5-^(^)l|Vff(x(t)) - Vg{x* 


d /I \ d 

+S7(-'‘ + «j+S 


7(^) ( t/l + g ) 1 + 


T] 


Id/ 7 (t) 


g dt \X{t) 


X 


, ( I'^jt) -7(t)A(t) -F7(t)A(f) _ 1_ _ 1 \ II . 

\gXit) gX^{t) 13 r?)" 




gX{t) 


< 0 . 
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This relation gives rise via (A5) to 


f5X{t)\\Vg{x{t)) (^^h + q^ + 

for almost every t G [0,+oo). This implies that the function 

^ ^ 1 + Ij ( 

is monotonically decreasing. Arguing as in the proof of Theorem El by taking into account that 
A, 7 have positive upper and lower bounds, it follows that + q, h, q, x,x,h,q are bounded 
and X, X, (Id — prox^j o(Id —ryV 5 ))x G L^([0,+oo); 7^). Furthermore, limi_j._|_oo x(t) = 0. Since 
Id — prox^j o(Id —ryV 5 ))x G L2([0,+oo);il^) (see Remark mb)), we derive from Lemma H] 
that limi_).+oo (id — prox^j o(Id —r]Vg)) (x(t)) = 0. As 

x{t) = -j(t)x(t) - \(t) (Id - prox^y o(Id -gVg)) (x(t)) 

for every t G [0, +oo), we obtain that limt_).+(X) x(t) = 0. From p8]l it also follows that V( 7 (x(-)) — 
Vg{x*) G L^([0,+oo); ^) and, by applying again Lemma 01 it yields limt_^+oo V( 7 (x(t)) = 
V 5 '(x*). In this way the statements (i), (ii) and (iv) are shown. 

(hi) Since the function in (1391) is monotonically decreasing, from (i), (ii) and (iv) it follows 

that the limit limt_>.+c« {^h + (t)^ exists and it is a real number. From limi_}._|_oo 7(t) G 

(0, +oo) we get that 3 lim^^+oo (t) G M. 

Furthermore, since x* has been chosen as an arbitrary minimizer of f + g, we conclude that 
for all X* G argmin 3 ,g^{/(x) + g{x)} the limit 

lim E(t, X*) G M 
t—>- + 00 


exists, where 

E{t,x*) = 7 ^||x(t) - x*f +g{x{t)) - g{x*) - {Vg{x*),x{t) - x*) . 

2g 

In what follows we use a similar technique as in [TB] (see, also, [H Section 5.2]). Since x(-) 
is bounded, it has at least one weak sequential cluster point. 

We prove hrst that each weak sequential cluster point of x(-) is a minimizer of f + g. Let 
X* G argmin 3 ,g^{/(x) + ^(x)} and —>■ +oo (as n ^ +oo) be such that {x(tn))neN converges 
weakly to x. Since {x{tn),Vg{x{tn))) G Gr(Vg'), lim„^+oo Vg'(x(tn)) = Vg{x*) and Gr(Vg') is 
sequentially closed in the weak-strong topology, we obtain Vg{x) = Vg{x*). 

From (|27p written for t = tn, A = df and B = \/g, by letting n converge to -|-oo and by using 
that Gr((9/) is sequentially closed in the weak-strong topology, we obtain —Vg{x*) G df{x). 
This, combined with Vg{x) = Vg{x*), delivers —Vg{x) G df(x), hence x G Zer(cl/ -|- Vg) = 
argmin,^g^{/(x) -b g{x)}. 

Next we show that x(-) has at most one weak sequential cluster point, fact which guarantees 
that it has exactly one weak sequential cluster point. This implies the weak convergence of the 
trajectory to a minimizer of f + g. 

Let X*, X2 be two weak sequential cluster points of x(-). This means that there exist tn —>■ +00 
(as n —)• -boo) and t'^ —)• -boo (as n —-boo) such that (x(tri))neN converges weakly to x\ (as n — >■ 
-boo) and {x{t'^))n<=N converges weakly to X 2 (as n —)• -boo). Since x|,X 2 G argmin 3 ,g-^{/(x) -b 
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( 7 (x)}, we have limt^^oo E(t,xl) € M and E(t,X 2 ) G M, hence 3 linit_>.+oo(-E'(i, 3 :|) — 

£'(t, X 2 )) G M. We obtain 


3 lim 
t —^“|~00 



{x{t),X2 


xl) + {Vg{x*2)-Vg{xl),xit)) 


G M, 


which, when expressed by means of the sequences (tn)neN and leads to 


1 

r/ 


/ * * 

(Xi,X 2 


xi:) + (V5(x^)-v5(xi:),xt) 


- {x* 2 , x *2 - xl) + {VgixD - Vg{xl),x* 2 ). 

g 


This is the same with 


-\\x*i - x*2f + {Vg{x*2) - Vg{xl),x*2 - x^) = 0 

g 

and by the monotonicity of V 5 we conclude that x^ = a^^- 

(v) The proof of this statement follows in analogy to the one of the corresponding statement 
of Theorem llUf vl written for A = df and B = 'Vg. ■ 


Remark 15 When 'y{t) = 7 > 0 for every t > 0 and X{t) = 1 for every t G [0,+ 00 ), the 
second inequality in (|33p is verihed if and only if 7 ^ > ^ + 1. In other words, (A5) allows in 
this particular setting a more relaxed choice for the parameters 7 , g and (3, beyond the standard 
assumptions 0 < g < 2/3 and 7 ^ > 2 considered in [9]. 


Remark 16 The explicit discretization of (13 ip with respect to the time variable t, with step 
size hn > 0 , relaxation variable > 0 , damping variable 7 ^ > 0 and initial points xq := uq and 
Xl := Vo yields the following iterative scheme 


Xn+l 2Xjj T Xn —1 Xfi-l -1 Xn , 

--h- 

I irn I In 


prox^j \^Xn - g'^g{Xn)) “ 


Vn > 1. 


For h„ = 1 this becomes 


Xn+l — I 1 


1 + 7n 


] Xn + prox^j (xn - gVg{Xn)) + ^ (Xn - Xn-l) Vn > 1, 

/ 1 + ' 7 n ^ ^ 1 + 7n 


which is a relaxed forward-backward algorithm for minimizing f + g with inertial effects. For 
more on inertial-type forward-backward algorithms we refer the reader to |28j . 


In the following we provide a rate for the convergence for a convex and (Frechet) differentiable 
function g : Ti ^ M with Lipschitz continuous gradient to its minimum value along the ergodic 
trajectory generated by 

f x{t) + 7 (t)x(t) Xit)Vg{x{t)) = 0 . . 

\ x( 0 ) = no,x( 0 ) = vo. ^ ’ 

To this end we make the following assumption: 


(A 6 ) A ; [ 0 , -|-oo) —>■ ( 0 , -l-oo) is locally absolutely continuous, 7 : [ 0 , -|-oo) —>■ ( 0 , -|-oo) is twice 
differentiable and there exists C > 0 such that for almost every t G [0, -|-oo) we have 

0 < C < 7 (^)'^(^) ~ 7 (^) < 0 and 2 'y{t)'y{t) — ^{t) < 0 . (41) 


Let us mention that the following result is in the spirit of a convergence rate statement recently 
given in [261 Theorem 1] for the objective function values on a sequence iteratively generated by 
an inertial gradient-type algorithm. 
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Theorem 17 Let g -.T-L he a convex and (Frechet) differentiable function with ^-Lipschitz 
continuous gradient for f > 0 such that argmin^^-^ g{x) / 0. Let A, 7 : [0,+oo) —)• (0,+oo) be 
functions fulfilling (A 6 ) uo,vo E H and x : [0,+oo) Li be the unique strong global solution of 

Then for every minimizer x* of g and every T > 0 it holds 


o<g 



- 9 {x*) < 


1 


^^0 + 7(0)('«o 


+ 



7(0) ||mo - X * 


Proof. By using (HOl) . the convexity of g and (A 6 ) we get for almost every t E [0, +00) 


x{t) + 'y{t){x{t) - x*)f + \{t)g{x{t)) - ^||x(t) - 
= {x{t) + i{t){x{t) - X*) + 7(t)x(t), x(t) + -f{t){x{t) - x*)) 

- -^Wxit) - - fit) {x{t),x{t) - X*) + X{t)g{x{t)) + X{t) {x{t),Vg{x{t))) 

= - {'^ 9 {x{t)),x{t) - X*) + X{t)g{x{t)) + (j{t)'y{t) - ||a:(t) - x*f 

< - 7(i)A(t) {Vg{x{t)),x{t) - x*) + X{t)g{x{t)) 

<(A(t) - -f{t)X{t)){g{x{t)) - g{x*)) + X{t)g{x*) 

< - Ci9{x{t)) - 9{x*)) + X{t)g{x*). 

We obtain after integration 

^||x(r) + 7 (r)(x(r) - + X{T)g{x{T)) - ^\\x{T) - 

-^ll®(0) + 7(0)(x(0) - - A(0)ff(x(0)) + ^^||x(0) - 

+C / i 9 {xit)) - 9 {x*))dt < (A(r) - X(0))g(x*). 

Jo 


A fl 

di V2 


Be neglecting the nonnegative terms in the left-hand side of the inequality above and by using 
that g{x{T)) > 9 {x*), it yields 


C igixit)) - 9 {x*))dt < i||uo 7(0)(wo - - -^Iko - x*\\^ + A(0)(5(mo) - 9{x*))- 

The conclusion follows by using 


9{uo) - 9{x*) < ^ll'“o -X* 


which is a consequence of the descent lemma (see [291 Lemma 1.2.3] and notice that \Jg{x*) = 0), 
and the inequality 


9 ( 7 ^ x(t)dt - g{x*) <— { 9 {x(t)) - 9 {x*))dt, 


which holds since g is convex. 


17 












Remark 18 Under assumption (A 6 ), we obtain in the above theorem (only) the convergence 
of the function g along the ergodic trajectory to a global minimum value. If one is interested 
also in the (weak) convergence of the trajectory to a minimizer of g, this follows via Theorem [ 6 ] 
when A, 7 are assumed to fulfill (Al) (notice that if x converges weakly to a minimizer of g, then 
from the Cesaro-Stolz Theorem one also obtains the weak convergence of the ergodic trajectory 
T I— ^ /(T x{t)dt to the same minimizer). 

For a,a',p,p' > 0 and b,b' > 0 fulfilling the inequalities b'‘^b > ^ and 0 < p < b' one can 
prove that the functions 

X{t) = - 7 -r and 7 (f) = a'e~^ * + b', 

verify assumption (Al) in Theorem [ 6 ] for 0 < 0 < b'^bf3 — 1 and assumption (A 6 ) in Theorem 
[13 for 0 < C < (a+b)'^ • Hence, for this choice of the relaxation and damping functions, both 
convergence of both the objective function g along the ergodic trajectory to its global minimum 
value and (weak) convergence of the trajectory to a minimizer of g are guaranteed. 
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